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(57) Abstract: The present invention 
relates to an interventional procedure 
simulation system, comprising a 
control unit and an interface unit, 
said control unit communicating 
with said interface unit to simulate 
handling of a number of simulated 
nested instruments simultaneously 
interfaced by said interface unit and, 
said instruments being arranged to 
move and rotated independently of 
each other and said movements and 
rotations being propagated to the 
other instruments. The control unit 
further comprises an instruction set 
comprising: a first instruction set 
for handling and processing input 
from said user, based on said input, 
generating a second instruction set 
for controlling said interface, a first 
data set comprising characteristics 
for said instruments, a second data 
set comprising data on a body part to 
be stimulated, and a third instruction 
set for generating control signals 
relating to an interaction between 
said simulated instruments and a 
surrounding geometry relating to a 
part of said simulated body part. 
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TITLE 

AN INTERVENTIONAL SIMULA TOR CON TROL SYSTEM 

TECHNICAL FIELD OF THE INVENTION 

The present invention relates to a computerized apparatus for simulating an interventional 
operation, and in particular the simulator portion of the arrangement. 

BACKGROUND OF THE INVENTION 

Principles of adult education, tenets of experiential learning, and theories addressing the 
development of expertise have all underscored the critical role experience plays in the 
learning process. State-of-the-art simulations can be successfully included In 
contemporary surgical and medical education to offer trainees and practicing physicians 
the requisite learning experiences based on these educational underpinnings. All learners 
can be offered opportunities to acquire the essential sl<ills and to achieve specified 
competency levels based on standardized learning experiences. Simulations can be used to 
facilitate learning through the evaluation of performance and provision of immediate, 
individualized, and detailed feedbacl<. Simulations offer controlled settings that allow 
repetition until the defined performance levels are achieved, decrease stress levels of 
learners, increase the confidence levels of learners, and increase safety in real settings by 
assuring the achievement of technical competence prior to work on patients. Practicing 
physicians can improve their skills and can learn new procedures emerging as a result of 
advances in science and technology through educational interventions involving the use of 
simulations. In addition, the use of simulations can help address practical issues, such as 
the demands on faculty time, by providing trainees the opportunities for independent 
learning and practice. The current emphasis on accountability and on assurance of the 
quality of health care may also be addressed through the use of such simulations and data 
on outcomes can be used to assure the public of the competence of physicians. 

Simulations should be considered an essential part of every contemporary educational 
program that addresses technical skills development. They can be used to ensure effective 
teaching and learning, to provide valid and reliable means of assessment of the skills of 
learners, to yield information on specific weaknesses that require improvement, and to 
create Individual prolnstruction sets of the technical ability of learners. In order to achieve 
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the desired results, specific curricula should be developed based on principles of adult 
education, experiential learning, and effective feedback. Such simulations may also be 
used in programs of continuing professional education and certification. The initial 
investment of resources needed for the development and acquisition of simulations and for 
5 the creation of training programs that incorporate them effectively in educational models is 
readily offset by the numerous advantages resulting from expeditious performance of 
procedures in the operating room, enhancement of patient safety, and decrease In the 
faculty time needed to teach learners various technical skills. Such simulations may also 
be used to assess the effectiveness of educational efforts and even to select individuals for 
10 training. Thus, the simulations have the potential to make a major Impact on programs of 
surgical and medical education of the future. 

As a result of the rapid developments within the computer technique, simulations, 
especially for the purpose of surgical and medical education, have improved considerably. 
15 However, the presently known apparatus and methods do not allow a full range simulation 
of different instruments used. 

United States Patent No. 6,106,301 discloses an Interventional radiology interface 
apparatus and method interfaces peripherals in the form of mock medical Instruments to a 

20 medical procedure simulation system to enable performance of a medical procedure on a 
virtual patient. The interface apparatus includes a guldewire, catheter and sheath, an 
injection syringe, an inflation syringe and a foot switch to realistically simulate the 
instruments utilized during an actual medical procedure. A user manipulates guldewire, 
catheter and sheath peripherals to traverse an arterial network toward a simulated 

25 blockage shown on the medical procedure simulation system display. The foot switch 

controls the display to provide a fluoroscope Image showing the position of the guldewire, 
catheter, sheath and blockage within the arterial network. The Injection syringe may be 
manipulated to simulate injections of contrast fluid or other pharmaceutical substances 
through the catheter or sheath Into the virtual patient. When a guldewire is positioned past 

30 the simulated blockage within the arterial network, the catheter is exchanged for a 

balloon-tipped angioplasty catheter, and the Inflation syringe Is manipulated to simulate 
Inflation of the balloon to reduce the blockage. In addition, the Interface apparatus may 
apply force feedback to the guldewire and catheter to simulate forces encountered by 
these instruments during an actual medical procedure. The Interface apparatus measures 

35 peripheral manipulation and transfers these measurements via a processor to the medical 
procedure simulation system to enable simulation of the medical procedure. 
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US6267599 discloses a system for producing highly realistic, real-time simulated operating 
condition for interactive training of persons to perform minimally invasive surgical 
procedures involving implements that are inserted and manipulated through small incisions 
in the patient. The virtual environment for this training system includes a housing with 
5 small opening. An implement simulating a surgical implement is inserted into the opening 
and manipulated relative to the housing. A movement guide and sensor assembly monitors 
the location of the Implement relative to the housing and provides data about the 
implement's location and orientation within the housing. The reported data Is Interpolated 
by a computer processor, which utilizes a database of Information representing a patient's 

10 internal landscape to create a computer model of the internal landscape of the patient. 
With reference to this computer model, the processor controls the occurrence of force 
feedback opposing the motion of the implement. A two-dimensional image representing 
the implement, as it would appear within the patient is generated by a processor- 
controlled video imaging system based on the computer model of the patient's internal 

IS landscape. This computer image of the implement is then merged with a video image loop 
of a patient's internal landscape as it appears through a heartbeat and breathing cycle, 
and the merged image is displayed on a video display. The combined elements of real-time 
visual representation and interactive tactile force feedback provide a virtual training 
simulation with all elements of actual operation conditions, minus a live patient. The 

20 system according to this invention handles only one instrument. 

WO 02/070980 describes a system and method for simulating image-guided medical 
procedures, particularly those relying on interventional and/or diagnostic devices such as 
catheters. This document shows in a simplfied embodiment a system for simultaneously 
25 simulating a plurality of simulated instruments; however, real instruments cannot be used 
and they cannot be used and simulated with each other through the same interface. It is 
thus not possible to obtain a realistic simulation where instrunrients act nested with other 
and interact with each other. 

30 SUMI^ARY OF THE INVENTION 

The main object of the preferred embodiment of the invention is to present a novel and 
effective method and system for a real-time surgical simulations, preferably cardiovascular 
or endovascular diagnostic or interventional procedures. 

35 
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_,_,_TheJnstmcUojiaLsysteiT^ lati.on_pro.vid.es_a_f ra mework for 
learning. 

Therefore, an interventional procedure simulation system, is provided comprising a control 
5 unit and an Interface unit, tlie control unit communicating with the interface unit to 

simulate handling of a number of simulated instruments simultaneously interfaced by the 
Interface unit, the control unit further comprising an Instruction set, comprising: a first 
Instruction set for handling and processing input from the user, based on the input, 
generating a second Instruction set for controlling the interface, a first data set comprising 

10 characteristics for the instruments, a second data set comprising data on a body part to be 
simulated, and a third instruction set for generating control signals relating to an 
interaction between the simulated Instruments and a surrounding geometry relating to a 
part of the simulated body part. The system of the invention can be used for many 
purposes, such as diagnostic, a cardiovascular or endovascular simulation system. Both 

15 real instruments and dummy Instruments may be used; the instruments are simulated 
assuming that they interact nested, i.e. inserted Into each other. A user's movements of 
the instruments, a surrounding simulated anatomy and other present instruments, affect a 
shape of an instrument simulated and displayed. Preferably, each Instrument collisions 
with simulated surrounding calculations are executed by the control unit, which affects the 

20 shape and position of the instrument In the simulated body part. In the most preferred 

mode, a sum of all instrument properties is considered, such that each nested tool can be 
moved and rotated independently of the other and the movements and rotations are 
propagate to other instruments. For simulation purposes, an Instrument Is a distal part of 
a tool, or unique features at the distal end of a tool. Different instrument types can be 

25 used comprising balloons, stents, electrodes, wires, catheters, distal protection, etc. Each 
instrument type has different properties associated to it and provided as an instruction set, 
which describes substantially all properties of the instrument. Thus, it is possible to 
simulate new instruments by obtaining geometrical Information on them. The properties of 
the Instruments further describe Interaction with surrounding geometry, visual properties, 

30 stiffness, shape etc. 

In a preferred embodiment, the system comprises a model used for rendering objects 
depending on properties to be displayed and a collision model for computing collisions 
between the simulated instrument and body part, A model of the body or part of the body 
35 part Is a three-dimensional data obtained through a body scanning. 
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IheJnventjon-aIso_i:elal:esJ:o-a_method_fjOJisJm^u^ 

comprising the steps of: providing a control unit and an interface unit, the control unit 
communicating with the interface unit to simulate handling of a number of instruments 
simultaneously Interfaced by the interface unit, providing a first instruction set for handling 
S and processing input from the user, generating a second instruction set based on the 
input, for controlling the interface, retrieving information on the Instrument comprising a 
first data set comprising characteristics for the instruments, providing a second data set 
comprising data on a body part to be simulated, and generating control signals relating to 
interaction between the Instrument and a surrounding geometry by a third Instruction set. 

10 The method also comprises simulating the instruments assuming that they interact nested, 
i.e. inserted Into each other. The method also comprises changing Instrument simulated 
and displayedbased on a user's movements of the instruments, a surrounding simulated 
anatomy and other present instruments, effect a shape of an instrument simulated and 
displayed. For nestled Instruments, the method also comprises considering a sum of all 

IS instrument properties, such that each nested tool can be moved and rotated independently 
of the other and the movements and rotations are propagate to other Instruments. 
Preferably, an instrument is a distal part of a tool, or unique features at the distal end of a 
tool. As different instrument types can be used comprising balloons, stents, electrodes, 
wires, catheters, distal protection, etc., the invention is highly flexible. Each instrument 

20 type has different properties associated to it and provided as an instruction set, which 

describes substantially all properties of the instrument. The properties of the instruments 
further describe interaction with surrounding geometr/, visual properties, stiffness, shape 
etc. 

25 According to one aspect of the invention, a system for an interventional procedure 

simulation is provided. The system comprises a control unit and an Interface unit, the 
system further comprising: means for communication between the control unit and the 
interface unit, means in the interface unit to simulate handling of a number of Instruments 
simultaneously Interfaced by the Interface unit, interface member for receiving input from 

30 the user, means for handling and processing the input, means for controllihg the interface, 
a first database for storing characteristics for the instruments, a second database for 
storing characteristics about a body part to be simulated, and means for generating 
control signals relating to an Interaction between the simulated instruments and a 
surrounding geometry relating to a part of the simulated body part. The characteristics 

35 about a body part to be simulated are obtained through a scanning process. 
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Th ^ inuP fi^-inn is hqsf rf^aliTeri as a computer program for I nterventiona l pr ocedure simulation in 
a system comprising a control unit and an Interface unit, and the program comprises: a 
communication instruction set for communication between the control unit and the 
interface unit, a first instruction set for simulating handling of a number of simulated 
5 Instruments simultaneously Interfaced by the Interface unit, the control unit further 
comprising an instruction set, comprising: a second instruction set for handling and 
processing input from the user, a third instruction set for controlling the interface, a first 
data set comprising characteristics for the Instruments, a second data set comprising data 
on a body part to be simulated, a fourth instruction set for generating control signals 
10 relating to an Interaction between the simulated instruments and a surrounding geometry 
relating to a part of the simulated body part, and a fifth Instruction set for outputting 
simulation on a visualisation member. 

The Invention also concerns a program storage device readable by a machine and encoding a 
15 program of Instructions for executing the computer program for interventional procedure 
simulation. 

The Invention also concerns a computer readable medium having computer readable program 
code embodied therein to enable an Interventional procedure simulation In a system 

20 comprising a control unit and an Interface unit, the program comprising: a communication 
Instruction set for communication between the control unit and the interface unit, a first 
instruction set for simulating handling of a number of simulated Instruments 
simultaneously Interfaced by the interface unit, the control unit further comprising an 
instruction set, comprising: a second instruction set for handling and processing input from 

25 the user, a third instruction set for controlling the Interface, a first data set comprising 

characteristics for the Instruments, a second data set comprising data on a body part to be 
simulated, a fourth Instruction set for generating control signals relating to an interaction 
between the simulated Instruments and a surrounding geometry relating to a part of the 
simulated body part, and a fifth Instruction set for outputting simulation on a visualisation 

30 member. 

r^oreover, the invention relates to a propagated signal for comprising a digitailzed program 
code eml3odled therein to enable an Interventional procedure simulation in a system 
comprising a control unit and an Interface unit, the program comprising: a digitailzed 
35 communication instruction set for communication between the control unit and the 
interface unit, a digitailzed first Instruction set for simulating handling of a number of 
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" simLUatedJnstrAjmerits-simultan^ control unit 

further comprising an Instruction set, comprising: a digltallzed second instruction set for 
handling and processing input from the user, a digltallzed third Instruction set for 
controlling the Interface, a digltallzed first access code for accessing a first data set 
5 comprising characteristics for the instruments, a digltallzed second access code for 

accessing a second data set comprising data on a body part to be simulated, a digltallzed 
fourth instruction set for generating control signals relating to an interaction between the 
simulated Instruments and a surrounding geometr/ relating to a part of the simulated 
body part, and a digitalized fifth instruction set for outputting simulation on a visualisation 
10 member. 

The invention also relates to a system for an interventional procedure simulation, the 
system comprising a control unit and an interface unit, the system further comprising: 
means for communication between the control unit and the Interface unit for receiving at 
least one instrument used in the interventional procedure, means for receiving three- 
dimensional information on a body part to be simulated, means for generating control 
signals relating to an interaction between the instruments and a surrounding geometry 
relating to a part of the simulated body part. The three-dimensional information is 
obtained through a scanning process. 

The Invention also relates to a system for an interventional procedure simulation learning, 
the system comprising a control unit and an interface unit, the system further comprising: 
means for communication between the control unit and the interface unit for receiving at 
least one Instrument used in the interventional procedure, means for receiving three- 
dimensional Information on a body part to be simulated, means for generating control 
signals relating to an interaction between the Instruments and a surrounding geometry 
relating to a part of the simulated body part, and means for recording the simulation. 

The invention also relates to a method of an Interventional procedure training, using a 
30 system comprising a control unit and an interface unit, the method comprising: using an 
interventional procedure tool to be simulated In the Interface device, simulating an 
interaction between the instruments and a surrounding geometry relating to a part of the 
simulated body part, using the simulation for training the user. 

'35 Ac£cr:ding to one aspect of the invention a method of facilitating an interventional 

s . 

procedure training, is provided by leasing a system comprising a control unit and an 
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Interface unit, the method comprising; using an Inteiventional procedure tool to be 

simulated in the interface device, simulating an Interaction between the instruments and a 
surrounding geometry relating to a part of the simulated body part, and using the 
simulation for training the user. 

5 

BRIEF DESCRIPTION OF THE DRAWINGS 

In the following, the Invention will be further described In a non-limiting way with 
reference to the accompanying drawings, in which: 

10 Fig. 1 schematically illustrates a block diagram according to one embodiment of the 
invention. 

Fig. 2 is a block diagram illustrating the kernel set-up according to the Invention, 
Fig. 3 is a fluoroscopic image generated with the system according to the Invention, 
Fig. 4 is a flow diagram Illustrating functional steps of a part of the Invention, 
15 Rg. 5 Is a schematic Illustration of Interface device according to one embodiment of the 
invention. 

Fig. 6 illustrates ah image of Visible Models, 
Fig. 7 illustrates an Image of Collision Geometries, 
Rg. 8 Illustrates a schematic vessel structure, 
20 Fig. 9 is a structured vessel hierarchy according to Fig. 8, and 

Figs. 10 and 11 are images of user interfaces according to one embodiment of the 
invention. 



DETAILED DESCRIPTION OF THE EI^BODIMENTS 



25 



An exemplar/ embodiment of a simulation apparatus according to the Invention is 
schematically illustrated in Fig. 1, The apparatus 100 comprises a computer unit 110 and 
an interface device 120. The computer unit 110 can be a conventional PC or similar, or a 
unit integrated with the interface device 120. The computer unit according to this 
30 embodiment communicates with a display unit 111, an input device 112 such as a 
keyboard and a mouse, and a communication interface (not shown). 



The interface device 120, described In a parallel application, entitled ''AN INTERVENTIONAL 
SIMULATION DEVICE'' (SE 0203568-1) by the same applicant and Incorporation herein . 
through reference, is arranged to receive a number instruments 121-123. 
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A user, e.g. a surgeon/physician, running a simulation uses the instruments connected to 
the interface device to practise a procedure. 

An interface device 500, schematically illustrated in Rg, 5, as a preferred embodiment. Is 
5 arranged to receive a number of instruments, dummies/real, preferably at least two 
instruments. The device comprises a number of moveable carriages 516A-516C 
corresponding to the number of the instruments, a common tracic 520, and an 
interconnecting member 526 provided as a telescopic tube. The interconnecting member 
26 interconnects the carriages 516A-516C serially. Each carriage Is provided with an 

10 opening for enabling reception of the instruments. Each carriage 516A-516C further 

comprises members to receive and lock at least one of the instruments, and members for 
receiving a movement from the Instrument dummy and generating a force fed back to the 
Instrument dummy with respect to a simulation characteristic. Preferably, each carriage 
comprises a detecting arrangement for detecting the type of the instrument dummy 

15 inserted through the interconnecting member. The interface device is connected to the 
control unit (PC) to measure the movement of each carriage and regulate the movement 
by means of a speed regulator and a distance regulator. Each carriage is connected with a 
gear belt transmission for driving along the track 520. Each carriage is provided with a 
crank block, which is arranged on a torque wheel. The crank block is provided with a 

20 mating surface, which is pressed towards a collet that grips the Instrument wire. Moreover, 
each carriage Is arranged with an outlet, which is provided with a detecting member, 
which detects presence of an instrument In the carriage. The detecting member is 
arranged to detect the thickness of each Instrument. The optical sensor detects presence 
of an Instrument In the carriage. The control unit measures a longitudinal movement and a 

25 movement of rotation, of the Instrument and gives force-feedback In the longitudinal 

direction and in the direction of rotation, of the instrument according to received force and 
torque. A locking member is arranged to damp an instrument, which Instrument is 
attached to a central wall. The locking member comprises a torque wheel, which is 
arranged in the central wall. The crank block is provided inside the torque wheel, which 

30 crank block moves in longitudinal direction. The crank block is fixed In the direction of 
rotation. 

The core of the system Is a control kernel, best embodied in form of a software based 
control system, which is loaded Into the memory of the computer unit. Then, the software 
35 kernel loads a three-dimensional geometry, e.g. representing vessels, heart, etc, and tool 
descriptions. The representations are preferably provided as data flies comprising for 
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e xample length segments (wit h va ri able len gth) ), diameter (inner and outer), angel with 
respect to the preceding (shape)^ rigidity^ If there is a balloon or EPD, or electrode tip, 
etc., "radioopacity", etc., pressure table for the balloon and so on. 

5 The movements of the tools are registered by the interface device and fed back to the 
Icernel. There, the supposed position and shape of the tool Is calculated. The result Is 
displayed as a synthetic fluoroscopic image on the display 111. An important and novel 
issue Is that in all applications, nested tools are used and all are active. The Instruments 
can be manipulated independently at any time, and will affect each other all the time. 

10 

The kernel 200 is schematically Illustrated in Rg. 2. In simulation, a patient is represented 
by a three-dimensional geometry. Each ""organ" of a patient is separate, with different 
visible/physical properties, for example a bone is denser than vessels, a kidney has low 
visibility but gradually becomes more visible as a contrast medium is injected, and can be 
IS animated independently (e.g. the heart and lungs have different frequencies). The 3D 
geometry are provided in two representations: 

- Visible Models (VMs) 210 are used for rendering purposes, see for example Fig. 6. 
Depending on properties they are displayed differently on the fluoroscopic display. 
The density for different tissues Is reflected In the visibility properties. 
20 - Coupled to the VMs are Collision Geometries (CGs) 220. Each vessel segment, for 

example, consists of connected cones (each vessel segment consists of many 
cones). One example Is Illustrated in Fig. 7. According to the most preferred 
embodiment of the invention, the vessels are arranged in a hierarchy. All vessels 
are provided in a database having a structured hierarchy as illustrated in Figs. 8 
25 and 9, which tells how vessels connect. Sub-functions such as Haptics 230, Physics 

240, Tools 260, Fluids 270, Dye 290 etc., (further described in the following) use 
these to compute collisions, forces, fluid flows, etc. The CGs are not visible, and 
usually have less resolution than the corresponding Model. However, a change in a 
CG will also result In a change fn the corresponding Model (described in more detail 
30 below.) The CG also has properties (per cone), which reflect stiffness; e.g., normal 

vessels have the same stiffness, but a lesion can be calcified and hence stiffer. 
Depending on, for example the vessel stiffness, the same tool could Interact 
differently with different parts of a vessel. 



35 



Fig. 3 illustrates a fluoroscopic Image of a cardiovascular procedure. The system 
reproduces the physics and physiology of the human cardiovascular system In the thorax. 
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. .JThis simulation can.be combined with a haptic Interface (230) to provide the user with an 
Intuitive way to Interact with the simulation. In this case, the training system consists of 
the software simulation of the cardiovascular system, the haptic interface device, the 
instructional system and two monitors, one for the synthetic x-ray and one for the 
5 Instructional system. The simulation consists of modules replicating the haemodynamics, 
blood flow and dye contrast media mixing, and catheter-vasculature physical Interaction. 
In addition, a module produces a synthetic x-ray image to replicate the fluoroscopic image 
used by Interventional cardiologists to guide them during their work. The algorithms used 
In the simulator are adapted from the cardiovascular mpdeling and analysis literature. The 
10 vessels 300 and a catheter 310 are illustrated In the image. 

The 3D geometry (both VMs and CGs) can be constructed In different ways: 

- They can be modeled in a 3D modeling software, i.e. from scratch using anatomy 
booics, video clips, etc as references only. 
15 - They can be reconstructed from real patient data, e.g. obtained through scans with 

Cr, MRI, Ultrasound, fiuoroscope, etc- 

Thus, for the software kernel, it is not important how the 3D geometry is constructed, and 
according to one of the most important features of the invention, a real-time simulation 
20 can be obtained as soon as patient data is optioned in three dimensions. 

A Physics function 240 calculates the '"behavior" of the instruments; Instruments In this 
context meaning long, flexible instruments, either hollow tubes or rigid wires. The 
instruments are nested (inside each other) and the maximum number of simultaneous 

25 tools according to this embodiment Is three. Each tool has its properties. I.e. "^natural 
shape", stiffness, length, diameters, radloopacity, etc. The properties are described In 
separate instruction sets for each instrument. The instruction sets are stored in a data 
storing means 260. The user's movements, surrounding anatomy and other present tools, 
will affect the shape of the tool. For each tool, collisions with the CG are calculated (for 

30 each tool only the part that is outside any other tool), which affects the shape and position 
of it. In the case of nested tools, the ''sum'' of all tool properties is considered. A catheter, 
for example, with a wire inside will act stifFer than the catheter alone. In addition, the 
shape of the catheter will be different with and without the wire inside (if the wire is 
relatively stiff compared to the catheter). Each nested tool can be moved and rotated 

35 independently of the other, due to the structure of the Interface device. These movements 
and rotations will propagate to the other tools. 
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Each instrument consists of a number of line segments represented by (dynamic) vectors. 
Dynamic vectors can have variable length. These are not evenly spaced, but depending on 
the curvature of the Instruments, the space varies. The spacing of line segments changes 
5 as the instrument moves and bends. 

The Physics Function 240 also calculates forces, both contact forces at each contact point 
(along each instrument and at the tip) and the forces that can be felt ""at the base'' (where 
the user holds the Instruments). The forces are thus simulated and felt by the user 
10 through the Interface device. 

Preferably, by a tool Is meant a distal part of an Instrument, or unique features at the 
distal end of an Instrument. Different tool types can be balloons, stents, electrodes, wires, 
catheters, distal protection, etc. Each unique "^instrument" belongs to a tool type. Each tool 

IS type has different properties associated to It, e.g. a balloon type has a pressure table that 
describes the shape under different pressures. Consequently, an Instrument of the type 
balloon then has Its own unique pressure table. In other words: For each unique 
instrument, there is a instruction set, which describes all properties, e.g. stiffness, shape 
etc., described In the Physics above, and for instance a pressure table. In one application, 

20 for example, there can be more than 40 different balloons, but all of the same type. 

The properties of the tools can be such that they describe interaction with surrounding 
geometry, or they can be more visual properties. As an example: A balloon expands under 
pressure. Ideally, it would expand according to a pressurie table. However, the surrounding 
25 geometry will hold back the expansion. Depending on the '^'stiffness'' of the vessel and the 
'"stiffness" of the balloon itself the result will be different. The balloon also has two marker 
points. These are characteristic for balloons, but are only visual cues for the length of the 
balloon. 



30 According to one embodiment, following exemplary tool types can be used: 

- 0.035" guide wire 

- Guide catheter 

- Balloon 

- Balloon expandable stent 
35 - Self expandable stent 

- Electrode 
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- Embolic protection device fliter 

- Embolic protections device sheatli 

- Diagnostic catheter 

5 - Middle guide catheter 

The surgical simulations are usually done as cardiovascular operations. Thus, for the 
simulation purposes, the fluid flow (blood) is ^pre-calculated", and done dependent on the 
geometry, e.g. iong, narrow vessels will have lower flow than large, wide vessels. Each 
10 time the geometry changes (opened by a balloon, blocked by a balloon, etc.) the flow Is 
recalculated. Preferably, as long as the geometry does not change the flow stays the 
same. As stated above, the flow depends on the geometric model. However, If the flow- 
splits are known for any bifurcations, then this can be given to the flow model as a starting 
statement. 

15 

It should be noted that It Is possible to expand any vessel with a balloon, and the flow will 
be affected accordingly. 

During a surgical operation, a contrast can be injected through hollow instruments. The 
20 contrast has its own speed and directions when it comes out of the instrument. Soon it is 
mixed with the blood, change direction and speed, and eventually ""fade" out. 

The system contains a dye simulation. A "^Dye model" 290 calculates this behavior, and 
keeps track of the position currently having enough concentration of contrast to be visually 
25 seen on the fluoroscopic image. Dye uses the CGs to compute this, but renders on the 

VMS. To make this procedure quick, there Is a mapping table executed in a pre-processor. 

The system also comprises a Lesion Model 280. A lesion is currently only a narrowing of a 
vessel, which might have different propertlies than the rest of the vessel. It Is 

30 accomplished in two ways: Either the 3D geometry is already provided with the lesion, 

which affects the fluid flow and makes it visible, or it can be applied on a '^healthy" vessel. 
A lesion In the latter meaning would then only be a geometric deformation of the 3D 
geometry, together with some special properties for that part of the vessel segment. The 
properties may Include stiffness, 'Vulnerability", I.e. the risk that It will break and cause 

35 emboli to break off, and more. 
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The apparatus further comprises a man- machine- Interface for communication with the 
user. Rgs. 10 and 11 are two screen examples. The user Interface UI consists of 
instructional material that guides the user through the procedure and can be very different 
depending on the user's needs. According to Fig. 10, a user can select between a numbers 
5 of functions in field 1011 and choose a tool and its type in a tool field 1012. Fig. 11 

illustrates an image of the fluoroscope Interface, comprising control field 1101 fluoroscope 
images 1102 and image recording control field 1103. 

Referring now to the flow diagram of Fig, 4, the user selects what tools, he/she is going to 
10 use before doing so. The selection is sent to the kernel, which might pass it on to an 
interface device, for instance. For simulation, the interface device needs to know what 
instruments to expect to function properly. The kernel then uses the properties of that 
particular Instrument in all of its calculations and renderings 250. The kernel also feeds 
back information to the user interface, such as time, fluoro time, amount of contrast used, 
IS tip forces, balloon/vessel ration, etc. This information can be used to give the user 
different types of feedback. 

The rendered image resembles the real fluoroscopic image, in a conventional way. During 
the procedure, the Inclination of the X-ray tube can be changed, the table the "patlenf is 
20 lying on can be moved, the zoom can be changed, brightness adjusted, etc, as on a real 
fluoroscope. It can be done using control inputs on a screen, using a joystick or using a 
real fluoroscopic panel. 

Recordings, so called cine loops, can also be done, as well as road maps. I.e. still images 
25 that can be used for guidance later on in the procedure. 

In the following, the invention will be described In conjunction with a number of non-limiting 
examples: 

30 Coronary balloon dilatation (PTCAVstenting 

The specific tool set fDr this application consists of: 
Guiding catheter, 

- guide wire 0.035", 

35 - coronary wire 0.014", 

balloon dilatation catheter, 

- and balloon expandable stent. 
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Also, distal protection can be used. The balloon and the stent can be used In same way; 
the balloon (also for the stent) Interacts with the vessel, which expands (see above). The 
blood flow changes, and the contrast when Injected. The stent Is simulated in such a way 
5 that it is visible and stays in place as the balloon is deflated. It Is also possible to enter 
with a larger balloon and inflate it again. This will influence both the stent and the vessel, 
so-called post dilatation. It Is also possible to first inflate a balloon, before using a stent, 
so-called pre dilatation. Simulation Is achieved by using force feedback, whereby a tight 
lesion Is felt, when going through with a 'Marge" balloon. 

10 

The procedure Is done in such a way that first the guide catheter and guide wire are 
advanced to access either the right or left coronary vessel tree. Contrast is then injected 
through the catheter to locate the lesion/stenosis. The view can be changed to obtain a 
perfect visualization of the lesion. Images can also be exported to and be used by a 

15 separate QCA (Qualitative C Assessment) program, for length and width measurement. 

Then the user can decide what sizes of bajloon/stent he/she wants to use. (Typically, some 
cine loops are recorded before and after balloon dilatatlon/stenting.) A thin guide wire 
(coronary wire) is first advanced through the catheter and into the vessel tree. The tip of 
the wire can be shaped in an angle (user selectable), and the wire is then steered through 

20 the vessel tree by rotating the wire, and pulling/pushing to find the right way past the 
lesion. The balloon/stent is then advanced on top of the wire, and positioned in the right 
place using the radioopaque markers. Contrast can be injected to see that it is positioned 
In the right place. Finally, the balloon/stent is inflated, held for some time, and then 
deflated. All the steps are simulated and can be performed as in real life. 

25 

Over-the-wire lead placement: 

The specific tool set for this application consists of: 
Guiding catheter, 
. guide wire 0.035" (optional), 
30 - venogram balloon, 

- '"coronary" wire 0.014", 
lead, and 
finishing wire. 

35 Specifically, the venogram balloon is used to block the flow and allow contrast be Injected 
on the opposite side of the balloon. In this case, it is assumed that we are in the veins and 



wo 2004/051601 



WO 2004/051601 



PCT/SE2003/001890 



Page 18 of 39 



-^__J±ieJiIoodJlows-In-the-o^^ _to_v(suallze-the_y.essels. The 

lead wedges in place, both visually and using force feedbaclc. 

The procedure Is as follows: The guide catheter is advanced to find the entry to the great 
5 cardiac vein (coronary sinus). Contrast Is used to locate this. Then the vein Is bloclced with 
a balloon to visualize the side branches of the vessels, where the lead Is going to be 
placed. The balloon Is retracted, a 0.014" guide wire inserted (same procedure as above to 
navigate). Finally, on top of the wire the lead is advanced until it wedges in place. This can 
be seen and felt. Then the wire Is removed. A finishing wire is inserted (or a lead 
10 extension), which is only used to hold the lead stable as the guiding catheter is removed. 

In case of self-expandable stents, they are covered with a sheath, which Is then retracted and the 
stent expands to a given size (but as it hits the vessel wall the final size will be dependent of the 
vessel ^'stiffness" and the properties of the stent itself). The properties of the stent, both visually, the 
15 way it expands and the effects It has on the vessel are simulated. The vessel can also be post dilated 
with a *Vegu!ar" balloon afterwards. 

A distal protection device stops emboli from moving further and bloci< very small vessels 
(which can be devastating in the brain). A filter ''baslcet'' can then be used attached to a 

20 wire and at first covered with a sheath. The wire and sheath is positioned past the lesion, 
and then the sheath Is retracted, leaving the basket as a protection for when the lesion Is 
dilated. Afterwards a recovery sheath Is advanced to close the basket and the two are 
together retracted. The behavior of the distal protection device is simulated, comprising 
how one handles it and the visible characteristics. Other types of protection devices are 

25 also possible to simulate, for example balloons that block the flow while dilating. 

Tool shaping tool, is a result of having tools Inside of each other with different shapes and 
stiffness, but It is being used many times and Is difficult to simulate with other approaches 
than according to the present invention: Take a tool with a shape, a catheter for instance, 
30 and Insert another tool, a stiff wire or a thinner catheter. As the Inner tool Is advanced, the 
shape of the outer tool is changed. This behavior comes "natural" In the present system, 
since the tools can move Independently and the outmost shape Is a result of ail inner tools' 
stiffness/col I is ions. 

35 According to the Invention, it Is also able to simulate tools that do not exist. This can be 
used for testing non-existing new tools. Thus, it Is possible to prototype the new features, 
e.g. a new sensor at the tip or a completely new "smart" shape, etc. Then physicians can 
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try the new tools (the interface device does not have to have the exact tool, the kernel will 
simulate the desired properties and change the apparent physical properties In real-time), 
and the system can measure whether the new features are used or not, compare the 
results to "standard" methods, etc. Besides interviewing the physicians and obtain their 
5 subjective opinions, there is also a way of obtaining objective measurements on the 
Interaction between humans and instruments. 



According to one aspect of the invention, a system for an Interventional procedure 
10 simulation is provided. The system comprises a control unit and an interface unit, the 
system further comprising: means for communication between the control unit and the ' 
interface unit, means in the interface unit to simulate handling of a number of instruments 
sirhultaneously Interfaced by the interface unit, interface member for receiving input from 
the user, means for handling and processing the input, means for controlling the Interface, 
15 a first database for storing characteristics for the instruments, a second database for 
storing characteristics about a body part to be simulated, and means for generating 
control signals relating to an interaction between the simulated instruments and a 
surrounding geometry relating to a part of the simulated body part. The characteristics 
about a body part to be simulated are obtained through a scanning process. 

20 

The Invention Is best realized as a computer program for interventional procedure simulation in 
a system comprising a control unit and an interface unit, and the program comprises: a 
communication instruction set for communication between the control unit and the 
interface unit, a first instruction set for simulating handling of a number of simulated 

25 instruments simultaneously interfaced by the Interface unit, the control unit further 
comprising an instruction set, comprising: a second instruction set for handling and 
processing input from the user, a third instruction set for controlling the Interface, a first 
data set comprising characteristics for the instruments, a second data set comprising data 
on a body part to be simulated, a fourth instruction set for generating control signals 

30 relating to an interaction between the simulated instruments and a surrounding geometry 
relating to a part of the simulated body part, and a fifth instruction set for outputting 
simulation on a visualisation member. 

The invention also concerns a program storage device readable by a machine and encoding a 
35 program of instructions for executing the computer program for interventional procedure 
simulation. 
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The invention also concerns a computer readable medium having computer readable program 
code embodied therein to enable an Interventional procedure simulation In a system 
comprising a control unit and an interface unit, the program comprising: a comnriunicatlon 
5 instruction set for communication between the control unit and the interface unit, a first 
instruction set for simulating handling of a number of simulated instruments 
simultaneously Interfaced by the interface unit, the control unit further comprising an 
Instruction set, comprising: a second instruction set for handling and processing input from 
the user, a third instruction set for controlling the interface, a first data set comprising 
10 characteristics for the instruments, a second data set comprising data on a body part to be 
simulated, a fourth Instruction set for generating control signals relating to an interaction 
between the simulated instruments and a surrounding geometry relating to a part of the 
simulated body part, and a fifth Instruction set for outputting simulation on a visualisation 
member. 

15 

Moreover, the invention relates to a propagated signal for comprising a digltailzed program 
code embodied therein to enable an interventional procedure simulation in a system 
comprising a control unit and an Interface unit, the program comprising: a digltailzed 
communication instruction set for communication between the control unit and the 

20 interface unit, a dlgitalized first instruction set for simulating handling of a number of 
simulated instruments simultaneously interfaced by the interface unit, the control unit 
further comprising an instruction set, comprising: a digltailzed second instruction $et for 
handling and processing Input from the user, a digltailzed third Instruction set for 
controlling the Interface, a digltailzed first access code for accessing a first data set 

25 comprising characteristics for the Instruments, a digltailzed second access code for 

accessing a second data set comprising data on a body part to be simulated, a digltailzed 
fourth Instruction set for generating control signals relating to an Interaction between the 
simulated instruments and a surrounding geometry relating to a part of the simulated 
body part, and a digltailzed fifth instruction set for outputting simulation on a visualisation 

30 member. 



The invention also relates to a system for an interventional procedure simulation, the 
system comprising a control unit and an interface unit, the system further comprising: 
means for communication between the control unit and the Interface unit for receiving at 
35 least one instrument used In the Interventional procedure, means for receiving three- 
dimensional information on a body part to be simulated, means for generating control 
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relating to a part of the simulated body part. The three-dimensional information is 
obtained through a scanning process. 

5 The Invention also relates to a system for an interventional procedure simulation learning, 
the system comprising a control unit and an interface unit, the system further comprising: 
means for communication between the control unit and the interface unit for receiving at 
least one instrument used in the interventional procedure, means for receiving three- 
dimensional information on a body part to be simulated, means for generating control 
10 signals relating to an interaction between the instruments and a surrounding geometry 
relating to a part of the simulated body part, and means for recording the simulation. 

The invention also relates to a method of an interventional procedure training, using a 
system comprising a control unit and an interface unit, the method comprising: using an 
15 interventional procedure tool to be simulated in the interface device, simulating an 

interaction between the instruments and a surrounding geometry relating to a part of the 
simulated body part, using the simulation for training the user. 

According to one aspect of the invention a method of facilitating an interventional 
20 procedure training, is provided by leasing a system comprising a control unit and an 
interface unit, the method comprising: using an interventional procedure tool to be 
simulated in the interface device, simulating an interaction between the instruments and a 
surrounding geometry relating to a part of the simulated body part, and using the 
simulation for training the user. 

25 

The invention is not limited to the shown embodiments but can be varied in a number of 
ways without departing from the scope of the appended claims and the arrangement and 
the method can be Implemented in various ways depending on application, functional 
units, needs and requirements etc. 



30 
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CLAIMS 

1. An Interventional procedure simulation system, comprising a control unit and an 
Interface unit, said control unit communicating with said Interface unit to simulate 

5 liandling of a number of simulated nested instruments simultaneously interfaced by 

said interface unit and, said instruments being arranged to move and rotated 
independently of eachi other and said movements and rotations being propagated to 
the other instruments, said control unit further comprising an instruction set 
comprising: 

10 "a first instruction set for handling and processing input from said user, 

> based on said Input, generating a second Instruction set for controlling said 
interface, 

■ a first data set comprising characteristics for said instruments, 
- a second data set comprising data on a body part to be simulated, and 
15 -a third instruction set for generating control signals relating to an Interaction 

between said simulated Instruments and a surrounding geometry relating to a 

part of said simulated body part. 

2. The system of claim 1, wherein said interventional procedure is at least one of a 
20 diagnostic, a cardiovascular or endovascular simulation system. 

3. The system of one of claims 1 - 2, wherein a user's movements of said instruments, a 
surrounding simulated anatomy and other present Instruments, affect a shape of an 
instrument simulated and displayed. 

25 

4. The system of claim 3, wherein for each instrument collisions with simulated 
surrounding calculations are executed by said control unit, which affects the shape and 
position of said Instrument In said simulated iDody part. 

30 5. The system of any of preceding claims, wherein an Instrument Is a distal part of a tool, 
or unique features at the distal end of a tool. 

6. The system of any of preceding claims, wherein different instrument types can be used 
comprising balloons, stents, electrodes, wires, catheters, distal protection, etc. 

35 
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associated to it and provided as an instruction set, wliich describes substantiaily aii 
properties of said instrument. 

8. The system of claim 6, wlierein the properties of said instruments further describe 
Interaction with surrounding geometry, visual properties, stiffness, shape etc. 

9. The system of claim 8, wherein simulated properties of said Instrument are altered In 
real-time. 

10. The system of any of preceding claims, wherein the system comprises a model (210) 
used for rendering objects depending on properties to be displayed and a collision 
model (220) for computing collisions between the simulated instrument and body part. 

15 11. The system of any of preceding claims, wherein a model of said body or part of said 
body part Is a three-dimensional data obtained through a body scanning. 

12. The system of claim 3, wherein said instrument movements and rotations interact 
simulated with other instruments. 

20 

13. A method for simulating an interventional procedure, comprising the steps of: 

■ providing a control unit and an interface unit, said control unit communicating with 
said interface unit to simulate handling of a number of nested instruments 
simultaneously interfaced by said interface unit and that each nested tool can be 

25 moved and rotated Independently of the other and said movements and rotations 

are propagated to other Instruments, 

■ providing a first instruction set for handling and processing input from said user, 

■ generating a second instruction set based on said input, for controlling said 
interface, 

30 ■ retrieving Information on said Instrument comprising a first data set comprising 

characteristics for said instruments, 

■ providing a second data set comprising data on a body part to be simulated, and 

■ generating control signals relating to interaction between said instrument and a 
surrounding geometry by a third Instruction set. 
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14.7116 method of claim 13, changlngJnsttument simulated and displayed based on a 
user's movements of said Instruments, a surrounding simulated anatomy and other 
present Instruments, effect a shape of an Instrument simulated and displayed. 

15. The method of any one of claims 13-14, wherein an instrument Is a distal part of a 
tool, or unique features at the distal end of a tool. 

16. The method of any one of claims 13-15, wherein different Instrument types can be 
used comprising balloons, stents, electrodes, wires, catheters, distal protection, etc. 

17. The method of claim 16, wherein each instrument type has different properties 
associated to it and provided as an instruction set, which describes substantially all 
properties of said instrument. 

18. The method of claim 16, wherein the properties of said instruments further describe 
Interaction with surrounding geometry, visual properties, stiffness, shape etc. 

19. The method of claim 16, wherein simulated properties of said instrument may bo are 
altered in real-time. 

20. A system for an interventional procedure simulation, said system comprising a control 
unit and an Interface unit, the system further comprising: 

" means for communication between said control unit an said Interface unit 
> means In said Interface unit to simulate handling of a number of nested 

Instruments, Independently movable and rotatable, simultaneously interfaced by 

said Interface unit, 

■ Interface member for receiving Input from said user, 

■ means for handling and processing said Input, 

■ means for controlling said interface, 

■ a first database for storing characteristics for said Instruments, 

■ a second database for storing characteristics about a body part to be simulated, 
and 

■ means for generating control signals relating to an interaction between said 
simulated instruments and a surrounding geometry relating to a part of said 
simulated body part. 
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21. The system of claim 20 wherein said characteristics about a body part to be simulated 
are obtained through a scanning process. 

5 22. A computer program for inten/entlonal procedure simulation in a system comprising a 
control unit and an Interface unit, said program comprising: 

■ a communication instruction set for communication between said control unit 
and said interface unit, 

■ a first instruction set for simulating handling of a number of simulated nested 

10 instruments, independently movable and rotatable, simultaneously Interfaced by 

said interface unit, said control unit further comprising an Instruction set, 
comprising: 

> a second instruction set for handling and processing input from said user, 

> a third Instruction set for controlling said Interface, 

15 "a first data set comprising characteristics for said instruments, 

■ a second data set comprising data on a body part to be simulated, 

■ a fourth instruction set for generating control signals relating to an interaction 
between said simulated nested instruments and a surrounding geometry 
relating to a part of said simulated body part, and 

20 "a fifth instruction set for outputting simulation on a visualisation member. 

23. A program storage device readable by a machine and encoding a program of instructions 
for executing the computer program for interventional procedure simulation according to 
claim 23. 

25 

24. A computer readable medium having computer readable program code embodied therein to 
enable an interventional procedure simulation In a system comprising a control unit and an 
Interface unit, said program comprising: 

■ a communication instruction set for communication between said control unit 
30 and said interface unit, 

■ a first instruction set for simulating handling of a number of simulated nested 

instruments, independently movable and rotatable, simultaneously Interfaced by 
said interface unit, said control unit further comprising an instruction set, 
comprising: 

35 "a second instruction set for handling and processing Input from said user, 

■ a third instruction set for controlling said interface, 
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■ a first data set comprising characterist ic s for said inst ruments, 

■ a second data set comprising data on a body part to be simulated, 

■ a fourtli instruction set for generating control signals relating to an interaction 
between said simulated nested Instruments and a surrounding geometry 

5 relating to a part of said simulated body part, and 

■ a fifth instruction set for outputting simulation on a visualisation member. 

25. A propagated signal for comprising a dlgltallzed program code embodied therein to enable 
an interventional procedure simulation In a system comprising a control unit and an 
10 interface unit, said program comprising: 

- a digitaiized communication instruction set for communication between said 
control unit and said interface unit, 

■ a dlgltallzed first instruction set for simulating handling of a number of simulated 

nested Instruments, independently movable and rotatable, simultaneously 
15 interfaced by said interface unit, said control unit further comprising an 

instruction set, comprising: 

■ a dlgltallzed second instruction set for handling and processing input from said 
user, 

■ a dlgltallzed third instruction set for controlling said Interface, 

20 "a digitaiized first access code for accessing a first data set comprising 

characteristics for said Instruments, 

■ a digitaiized second access code for accessing a second data set comprising data 
on a body part to be simulated, 

- a digitaiized fourth instruction set for generating control signals relating to an 
25 Interaction between said simulated nested instruments and a surrounding 

geometry relating to a part of said simulated body part, and 
> a digitaiized fifth Instruction set for outputting simulation on a visualisation 
member, 

30 26. A system for an interventional procedure simulation, said system comprising a control 
unit and an interface unit, the system further comprising: 

■ means for communication between said control unit an said Interface unit for 
receiving at least one instrument used in said Interventional procedure, 

■ means for receiving three-dimensional information on a body part to be 
35 simulated, and 
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> means for generating control signals relating to an Interaction between said 
instruments and a surrounding geometry relating to a part of said simulated 
body part. 

5 27. The system of claim 26, wherein said three-dimensional information is obtained 
through a scanning process. 

28. A system for an interventional procedure simulation learning, said system comprising a 
control unit and an Interface unit, the system further comprising: 

10 ■ means for communication between said control unit an said ihterface unit for 

receiving at least one instrument used in said interventional procedure, 
- means for receiving three-dimensional Information on a body part to be 
simulated, 

■ means for generating control signals relating to an interaction between said 
15 instruments and a surrounding geometry relating to a part of said simulated 

body part, and 

■ means for recording said simulation. 

29. A method of an interventional procedure training, using a system comprising a control 
20 uhit and an interface unit, the method comprising: 

■ using an interventional procedure tool to be simulated in said interface device, 

■ simulating an interaction between said nested instruments, independently 

movable and rotatable, and a surrounding geometry relating to a part of said 
simulated body part, and 
25 > using said simulation for training said user. 

30. A method of facilitating an Interventional procedure training, leasing a system 
comprising a control unit and an interface unit, the method comprising: 

■ using an interventional procedure tool to be simulated In said interface device, 
30 ■ simulating an interaction between said nested Instruments, independently 

movable and rotatable, and a surrounding geometry relating to a part of said 
simulated body part, and 
" using said simulation for training said user. 



35 
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